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Abstract 

We comment on some recent, yet unpublished results concerning in- 
stabilities in complex systems and their applications. In particular, we 
briefly describe main observations during extensive computer simulations 
of two lattice nonequilibrium models. One exhibits robust and efflcient 
processes of pattern recognition under synaptic coherent activity; the sec- 
ond example exhibits interesting critical behavior and simulates nucleation 
and spinodal decomposition processes in driven fluids. 
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1 Introduction 

Nature may be viewed as a collection of complex systems 0|. Consequently, a 
principal question is how these systems, which typically consist of many simple 
interacting units, develop qualitatively new and high-level kinds of organization. 
This is the problem of connecting the microscopies of constituents with the 
coherent structures that characterize organisms and communities. It may often 
be assumed that the fundamental laws of physics, such as Hamilton and Maxwell 
equations, are individual properties of the units. Still, it is only very rare that 
the origin and form of natural phenomena can be inferred from basic laws. 
What is the relevance of fundamental physics to predict the weather, to design 
new materials and drugs or to understand the origin of life? It is remarkable 
that statistical physics recently addressed the problem of connecting emergent 
behavior to the constituents' properties in a more indirect manner, too. That is, 
main concepts in the theory of phase transitions, such as correlations, criticality, 
scale invariance and self-similarity that characterize the global behavior of the 
simplest model cases happen to be ubiquitous in nature. This brings many 
interesting, high-level phenomena to the attention of physicists, and the study 
of (nonequilibrium) phase transitions has consequently been animated 0. 
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As a matter of fact, an important observation in nature is that the complex 
systems of interest are often open, and out of a thermodynamic equihbrium 
state. Their simplest condition is that of a nonequilibrium steady state. That 
is, a constant flux of some quantity (matter, energy,...) is typically involved 
and the state is, in general, not determined solely by external constraints, but 
depends upon their history as well. Under such a nonequilibrium condition, as 
the control parameters — temperature or potential gradients, or reactant feed 
rates, for instance — are varied, the steady state may become unstable and be 
replaced by another (or, perhaps, by a periodic or chaotic state). Nonequilib- 
rium instabilities are attended by ordering phenomena so analogous to those of 
equilibrium statistical mechanics that one may speak of nonequilibrium phase 
transitions. These are ubiquitous in physics and biology, and have also been 
described in the social sciences ^, ^, |^ . 

The simplest examples of nonequilibrium phase transitions occur in lattice 
models. The analysis of more realistic situations is presently confronted, among 
other problems, with the lack of a general formalism, analogous to equilibrium 
statistical mechanics. That is, nonequilibrium dynamics is not derivable from an 
energy function. One must actually find time-independent solutions of master 
or kinetic equations, which is a formidable task in practice. Therefore, general 
theoretical approaches are scarce. It is true that, for cases in which fluctuations 
are of minor significance, a macroscopic description, i.e., a set of partial differ- 
ential equations is often preferable to a lattice model, for instance, in predicting 
a nonequilibrium phase diagram. However, such macroscopic descriptions imply 
mean-field behavior, while lattice models exhibit a range of critical phenomena 
and other details which are at least as interesting as in equilibrium [Q. The 
lack of theory also explains that most interesting information has been gained 
by means of computer simulations of the lattice models. 

2 Neural cellular automata that efficiently rec- 
ognize a pattern 

As a first example of a complex lattice system that exhibits nonequilibrium 
phase transitions, let us consider an artificial neural network that was introduced 
and studied before ||^. This consists of a set of N binary neurons, s = {sx = 
±1; X = 1, . . . , N}, evolving in time by stochastic equations, 

9tPt(s, J) ^ p^[-tnj(sx ~s^)Pt{s,3) +mj{s^ -Sx)Pt(s'', J)] 

X 

- p)J2J2^-^^'^-y ^ J'xy)Pt{s,3) + wiJ'„j ^ j^y)Ptis,3^y)] (1) 

Here J = {Jxy S 5R; x, y = 1, . . . , N} is the configuration of synaptic intensities, 
and s'' (J^'^) stands for s (J) after the change Sx —Sx {Jxy — *■ J' xy)- The 
function vj{Jxy J' xy) is taken independent of the current s, and wj^s^ — * 
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—Sx) = f (22^ ^Sx^x) , where 



= /ix(s, J) = X! -^^y^y (^) 
y 

is a local field. 

For p = 1, (|l|) reduces to the familiar Hopfield model in which the neurons 
evolve in the presence of a set of (frozen) synaptic intensities. It is assumed 
that these in some way contain information from a set of P stored patterns, 
C = {^x = ±1; X = 1, . . . , TV} , e.g., the Hebb choice J^y cx ^^^^ C^^^ after 
appropriate normalization. Under such conditions, the model asymptotically 
tends to the equilibrium state for temperature T and energy function, H = 
X^x ^xSx- This state sometimes corresponds to a configuration closely resembling 
one of the stored patterns; the system is therefore said to exhibit associative 
memory. However, this simple case is not sufficiently efficient for applications; 
e.g., errors when recovering a given pattern are large for most values of N, P 
and T, and the steady state may not be "pure" but correspond to a mixture of 
two or more stored patterns. 

For p — » 0, equation transforms into 

dtPM = [^(s";x)Pt(s^) - tn(s;x)Pt(s)] , (3) 

X 

where the transition probabihty per unit time is the superposition 

tn(s; x) = y dJ/(J)^ [2T-isx/ix (s, J)] . (4) 

For appropriate choices of this superposition, i.e., of functions / and (p, this 
system behaves qualitatively differents from the Hopfield case. That is, it 
can be shown — analytically in some cases and, more generally, by computer 
simulations — that a second-order (equilibrium) phase transition for p — 1 trans- 
forms for p ^ Q into a first-order (nonequilibrium) phase transition. This has 
some dramatic consequences concerning the recognition of a given pattern out 
of a deteriorated image of it. In particular, for a wide and practically interest- 
ing range of N, P and T, mixture states do not occur and the recovery process 
happens to be rather robust and accurate 

This study induced us to investigate a cellular automaton version of the 
original model. Firstly, the function ip is properly determined; this choice im- 
portantly affects in practice some of the system properties, e.g., the nature of 
its phase transitions. The simulation then proceeds by choosing at random any 
of the stored patterns, say /x, and updating all the neurons in the lattice as- 
suming the set Jxy — ^x^yi the synaptic intensities corresponding to the 
selected pattern. Next, this step is repeated again and again. The draw is per- 
formed in such a way that the time average for each local Jxy gives Hebb's rule, 
{Jxy) CxCy (o'^i alternatively, any other learning rule one may use in 

the system definition). 
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The preliminary results that are available at the time of this writing reveal 
that this case exhibits a very robust and efficient process of pattern recogni- 
tion. For most parameter values, starting from a perturbed pattern, the system 
rapidly transforms that configuration into the stored pattern that is closest to 
it. Figure 1 shows the time evolution of the overlap between the actual state of 
the system and one of the stored patterns at indicated temperature. This is in 
units of the respective model critical temperature, either = 0.1 and T^* = 1 
for our system and for the Hopfield case, respectively. Type 1 here refers to 
the case in which the system stores P = 150 patterns whose sites are generated 
completely at random, so that each site is independent of the others; type 2 
is for P = 90 stored patterns generated using the logistic map in the chaotic 
region of its parameter space, so that some correlation exits between sites. In 
both cases, our algorithm rapidly detects the pattern which is closest to the 
initial state. This behavior holds essentially for other values of the parameters. 

The reason behind the good properties of our system seems to be that, for 
appropriate dynamics, the actual state only evolves noticeably at steps in which 
synapses correspond to the selected pattern . This behavior opens the model 
to a wide range of possible applications. 



3 Spinodal decomposition and criticality in driven 
fluids 

The driven lattice gas (DLG) is a d— dimensional (d = 2 in the following) lattice 
gas at temperature T in which transitions in (against) one of the principal 
lattice directions — say ||, to be referred to as the field direction — are favored 
(unfavored). For periodic boundary conditions, this induces a net current of 
particles along the field direction. At high T, the system is in a disordered state 
while, for half-filled lattices (the only case of interest in this paper), there is a 
second-order (nonequilibrium) critical point, below which the DLG segregates 
showing anisotropic, stripe- like configurations parallel to the field 

Establishing the universality class of the DLG is a main issue not only con- 
cerning a better understanding of these model properties but also much more 
generally, in relation to the theory of nonequilibrium phase transitions and crit- 
ical phenomena. In fact, the DLG is recognized as one of the more intriguing 
model examples of nonequilibrium phenomena. 

Recent field theory H, ^ motivated performing new and extensive computer 
simulations. These focused on the case of an "infinite" drive (particles along 
the field direction are not allowed to go backwards) for both large squares and 
rectangular L\\ x lattices of different, appropriate sizes. It has thus been 
demonstrated numerically that the DLG belongs to the same universality class 
as a lattice gas under a randomly fiuctuating field, [|| so that (using the renor- 
malization group jargon) the particle current — which does not occur in the 
latter — is not a relevant feature of the DLG. Main critical exponents follow for 
both cases as /3 = 0.33(1), ~ 1.25 and ~ 2i>ji_. These important results 
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(that have more recently been confirmed independently ||T^ ) can be interpreted 
within the context of the existing field theory |8[ ^ . It should be noted however, 
that the present form of this theory does not fit well the results of further numer- 
ical investigation of the same model. That is, studying small values of the field 
suggests that the DLG has no relation to the equilibrium lattice gas — so that 
one cannot go perturbatively from the latter to the case of small fields. There 
is some indication that the DLG belongs to the same universality class with 
/3 < 1/2 for any value of the field as long as the configurations are stripped |pl| . 
If this is confirmed, the chances are that the DLG will again attract considerable 
attention during the coming years. 

In fact, in addition to the above issue on criticality, there are further interest- 
ing questions concerning this model. One is the nature of its kinetic behavior as 
a configuration evolves from a disordered state to the stripped one. Extending 
the arguments first checked for systems that evolve towards equilibrium, one 
should perhaps expect self- similarity with time of the structure function. That 
is, as the system undergoes nucleation and then cluster coagulation according 
to a sort of spinodal decomposition, even though this is strongly anisotropic and 
will eventually lead to a nonequilibrium steady state, it seems reasonable to as- 
sume the existence of a unique relevant length. One should expect this to be the 
length that characterizes the (transverse) clustering process in the system, say 
£ (t) . Consequently, quantities changing with time should not depend explicitly 
on the time variable but only through i (t) . For example, the structure function 
iS* (fc, t) is expected to depict a scaled form s(fc'), independent of t, when plotted 
accordingly, 

S{k,t) oc£{t)S{ke{t)) (5) 

This has recently been confirmed using the width of the stripes as the rel- 
evant length, as shown in Fig. 2. Moreover, we found that s{k) ^ k^^ for 
large values of k, which is the generalization of Porod's law to DLG. This power 
law behavior, as compared to the k~^ tail observed in bidimensional equilib- 
rium binary mixtures, reflects the fact that coarsening in DLG is effectively a 
unidimensional process which takes place in the direction perpendicular to the 
field. 

It has also been shown that I (t) ^ t^^^, in general, as in standard spinodal 
decomposition, [p^ though the mechanisms leading to this behavior seem to be 
different. More specifically, we found that £{t) = a(t/L||)^/'^ -1-6 for long enough 
times, where a and b are constants which depend on temperature, while for 
intermediate times we observe £{t) ~ (t/iy)^/'^ (see Fig. 3). 

The analysis of all the above results on the dynamics of DLG allows us to 
conclude that the particle current does not play any important role in the late 
stage coarsening of DLG, the anisotropy being the relevant ingredient present 
in this process. 

These facts motivate investigating experimentally spinodal decomposition in 
samples under nonequilibriimr anisotropic conditions, e.g., scattering studies of 
fluids under shear. 
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Figure 1: The time evolution of the overlap in our cellular automata (two upper 
curves) is compared here with the Hopfield case (two lower curves). Note that, 
on the time scale of the experiment, only our system depicts a clear tendency 
towards saturation. See the text for more explanations. 



io' 



S- 10" 



CO 



10"' 




10 



100 

kxl(t) 



1000 



Figure 2: Scaling of S{k, t) for different times between 10^ MCS and 10^ MCS 
in a 128 x 128 system at low temperature, T = 0.57Tc. Two lines of slope —2 
and —3, are indicated. 
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Figure 3: In this figure we show £{t) versus t" for both L± x L|| = 64 x 64 (a) and 
256 X 64 (6), and where a = 1/4 and 1/3 has been used, respectively. Notice 
that both plots follow a lineal law of the form £{t) = at" + b. 1/4-behavior 
dominates the full evolution of the smaller system, while the larger one reaches 
the long time limit, thus showing 1/3-behavior. In the insets we show x^(q^) for 
three different measures of the mean stripe width i(t). Its minimum signals the 
experimental value of the growth exponent a. 
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